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Abstract 

We review some applications of central limit theorems and extreme 
values statistics in the context of disordered systems. We discuss several 
problems, in particular concerning Random Matrix Theory and the gen- 
eralisation of the Tracy- Widom distribution when the disorder has "fat 
tails". We underline the relevance of power-law tails for Directed Poly- 
mers and mean-field Spin Glasses, and we point out various open problems 
and conjectures on these matters. We find that in many instances the 
assumption of Gaussian disorder cannot be taken for granted. 

1 Introduction 

Most statistical models of disorder start by assume that randomness has Gaussian 
statistics - from the classic Brownian motion to the Edwards-Anderson (or Derrida) 
models of spin-glasses, Kraichnan models of turbulent flows, KPZ models of surface 
growth, Black-Scholes models of financial markets, etc. Thanks to the outstanding 
mathematical properties of Gaussian random variables, this assumption is often tech- 
nically very convenient and allows one to use powerful analytical techniques: stochastic 
calculus and Ito's lemma, field theory and replicas, etc.. The real (and often implicit) 
justification is however the existence of a Central Limit Theorem. This should ensure 
that one large enough lengths scales or time scales, the physical results are universal, 
independent of the details of the microscopic randomness - which can therefore, for 
simplicity and congeniality, be chosen as Gaussian. The paradigm of such a mechanism 
is the Brownian motion; in this case, provided elementary hops are sufficiently decor- 
related from one another, it is well known that the sum of a very large number of these 
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small displacements leads to a Gaussian diffusion profile, quite independently of the 
distribution of elementary hops - whenever its second moment is finite. If the second 
moment diverges, the walk becomes a Levy flight, with anomalous diffusion described 
by the generalized Central Limit Theorem of Levy and Gnedenko which again ensures 
a certain degree of universality [1J: only the extreme tails of the microscopic distri- 
bution matter in the macroscopic limit. Although this dichotomy between finite and 
infinite variance is asymptotically rigorous, finite time or size effects can be strong and 
lead to effective violations of these Central Limit Theorems. An important example 
is when the distribution of elementary hops has a finite variance but power-law tails. 
In this case, fat tail effects are persistent and convergence towards Gaussian diffusion 
is very slow. This is particularly relevant in finance, where significant deviations from 
Gaussian statistics are observed even for long time lags [2]. 

Sums of N IID random variables therefore provide a beautiful illustration of univer- 
sality and universality classes, a concept that extends far beyond this simple, exactly 
soluble example. The existence of generalized Central Limit Theorems for more com- 
plicated (non linear) problems involving random variables should be generic, again 
leading to some universality - universality classes should however be determined on a 
case by case basis and might be different from the Levy-Gnedenko classification. A well 
known example is the statistics of extreme values, say the largest of N independent 
random variables x%. In this case again, the limiting distribution becomes to some 
degree universal; one has to distinguish three different cases, depending on the 'micro- 
scopic' distribution p(x): Weibull (for distributions p(x) which strictly vanish beyond 
a finite value x*), Gumbel-Fisher-Tippett (for distributions decaying faster than any 
power-law) and Frechet (for power-law distributions) [3] . Interestingly, it is possible to 
formulate a problem which interpolates between sums of random variables and extremes 
of random variables, by considering the following quantity: 



where one assumes for simplicity that Xj's are all positive. Clearly, q = 1 corresponds 



i max . Defining Xi = exp — £j, it is clear that S q plays the role of a partition function and 
q is the inverse temperature for a generalized Random Energy Model (REM), where 
the energies e^s are not necessarily Gaussian. This problem was considered in [H [5] 
and has, beyond the REM interpretation, many different applications. For example, 
suppose £j is a growth rate of specie i in the population, or the return of asset i in a 
portfolio, and q is the time. Then S q is the total population after time q or the total 
value of the portfolio after time q; the detailed statistics of these objects is therefore 
quite interesting result depends on the relative value of q and N when both diverge 
to infinity. More precisely, taking for simplicity £j to be Gaussian with variance a 2 , 
the relevant parameter is /j, = \ll In N jqa. The statistics of S q (N) only depends on fi 
and, quite interestingly, closely follows the above Gauss/Levy dichotomy: for [i > 2, S q 

1 More complex situations, for example diffusion of species in a random environment, can 
be analyzed along similar lines [6]. 
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to a simple sum, whereas when q — > oo at fixed N, S q converges to the largest element 
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is Gaussian; for \i < 2 it becomes Levy distributed and more and more dominated by 
extreme values. In fact, as soon as \i < 1, the whole sum S q is well approximated by a 
finite number of terms, whereas when ^ — > 0, only the largest survives. The transition 
at /x = 1 corresponds exactly the glass transition in the REM. The above results can be 
extended to any distributions of £j in the Gumbel class, up to a redefinition of ^ [HE]; 
interestingly, the detailed statistics of S q is precisely encoded in the 1-step Replica 
Symmetry Broken solution of the generalized Random Energy Model H] . 

As the above example illustrates, it is clear that low temperature/long time proper- 
ties of disordered systems are sensitive to extreme values rather than to typical values; 
this change of focus means that one should a priori be specially weary about univer- 
sality classes and the influence of the choice of distribution on the physical results. 
The aim of this paper is to discuss several problems within this perspective, reviewing 
some recent and older results, and pointing out several open problems and technical 
challenges well worth investigating in the future. 

2 Random Matrices and Top Eigenvalues 

A remarkable example of universal limit distribution is the eigenvalue spectrum of 
random symmetric N x N matrices M with iid real elements. Again, as soon as 
the variance of the matrix elements is finite, the eigenvalue density p(X) converges 
to the Wigner semi-circle, with edges at A = ±2 when the variance of the entries 
is normalized to 1/N. This result can be derived in a way which makes direct use 
of the Central Limit Theorem for sums of random variables, and in this way makes 
explicit the mechanism underpinning the universality of the Wigner semi-circle. In line 
with the above classification, one finds that where the variance of entries diverge, the 
eigenvalue spectrum p(A) of M is no longer the Wigner semi-circle. Not surprisingly, 
the discussion parallels the Levy-Gnedenko classification for sums of random variables. 
The case where the distribution of entries decays as a power-law ~ |Mjj| _1 ~ M (possibly 
multiplying a slow function) with /j, < 2 (such that the variance of entries diverge) , the 
eigenvalue spectrum p(X) can be computed exactly [HJ [9] and has no longer a compact 
support, but itself acquires power-law tail p(A) ~ |A| _1 ~ M , bequeathed from the tails of 
the matrix entries [8]. The structure of eigenvectors is also quite interesting: whereas 
for /i > 2 most states are extended, various localisation transitions occur, as a function 
of A, for p < 2. 

Following the above discussion, it is quite natural to investigate the distribution of 
extreme eigenvalues as well, and to find the universality classes corresponding to this 
question. Since the eigenvalues of a random matrix are strongly correlated random 
variables, one does not expect the result to belong to any of the well known Gumbel- 
Fisher-Tippett, Weibull and Frechet cases. One of the most exciting recent result in 
mathematical physics is the Tracy- Widom distribution of the top eigenvalue of large 
Gaussian random matrices [TO]. The truly amazing circumstance is that the very 
same distribution also appears in a host of physically important problems [llj: crystal 
shapes, exclusion processes [12], sequence matching, and, as discussed in the next 
section, directed polymers in random media. 

Again, the Tracy- Widom result is expected to hold for a broad class of random 
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matrices. The precise characterisation of this class, as well as the extension of the 
Tracy- Widom result for other classes, is a subject of intense activity [H1[T5]. The case 
where the distribution of entries decays as a power-law ~ \Mij\~ l ~^ is expected to fall 
in a different universality class, at least when /i is small enough. The situation is simple 
when fjL < 2: for large A, eigenvalues become uncorrelated and, as mentionned above, 
distributed as p(X) ~ |A| _1_/i . Correspondingly, the largest eigenvalues are described 
by Frechet statistics [16J. What happens when fi is in the range ]2, +00), such that the 
eigenvalue spectrum p(X) still converges [8], for large N, to the Wigner semi-circle? We 
find that Frechet statistics holds whenever p < 4, whereas the Tracy- Widom applies 
asymptotically as soon as [i > 4, with a new limiting family of distributions for /i = 4 
|17j . The idea of the method is to start with a real symmetric matrix M with iid 
elements of variance equal to 1/N, and such that the distribution has a tail decaying 
as: 

where the tail amplitude ensures that M^-'s are of order AN~ 1 / 2 . As soon as fi > 2, the 
density of eigenvalues converges to the Wigner semi-circle on the interval A G [—2,2], 
meaning that the probability to find an eigenvalue beyond 2 goes to zero when N — > 00. 
However, this does not necessarily mean that the largest eigenvalue tends to 2 - we will 
see below that this is only true when fj, > 4. Now, we perturb the matrix M by adding 
a certain amount 5 to a given pair of matrix elements, say (a, (3): M a p — > M Q/ g + 5 
and Mp a — > Mp a + 5. What can one say about the spectrum of this new matrix? 
Using self-consistent perturbation theory, which becomes exact for large N, one can 
show [17] that when |5| > 1, there is a pair of eigenvectors partly localised on a,/?, 
with eigenvalues A± = ±(5 + 1/5) with |A| > 2, which is therefore expelled from the 
Wigner sea. When |5| < 1, one the other hand, no such eigenvalue exist and the edge 
of the spectrum remains A max = 2 in this case. 

Now consider large matrix entries \Mij\ > 1. From Eq. ([2]), their number is 
N 2 Ii° p(Mij)dMij = A^N 2 ~vl 2 . In the case n > 4, it is clear that this number tends 
to zero when N — > 00. With probability close to unity for large N, no entry is larger 
than one, in which case the largest eigenvalue is expected to remain Tracy- Widom 
around A* = 2. With small probability, however, the largest element 5 of M exceeds 
one; its distribution is A^N 2 '^/ 2 /\S\ 1+fl and the corresponding largest eigenvalue, using 
the above analysis, is A max = S + 1/5. For (j, > 4 and large but finite N, we therefore 
expect that the distribution of the largest eigenvalue of M is Tracy- Widom, but with 
a power-law tail of index [i that very slowly disappears when — > 00. Our numerical 
results are in full agreement with this expectation (see Fig. 1). When \x < 4, on the 
other hand, the number of large entries increases with N. However, when fi is larger 
than 2, such as to ensure that the eigenvalue spectrum still converges to the Wigner 
semi-circle, the number of row or columns where two such large entries appear still tends 
to zero, as N 2 ^^. Therefore, the above analysis still holds: for each large element Sij 
exceeding unity, one eigenvalue A = Sij + will pop out of the Wigner sea. Even 
if the eigenvalue density tends to zero outside of the interval [—2, 2] when 2 < fi < 4, 
the number of eigenvalues exceeding 2 (in absolute value) grows as 

N 2-^/2 < N _ The 

largest eigenvalues are then equal to the largest entries and are themselves given by a 
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Figure 1: Histogram of A max conditioned on \S\ < 0.95 for /j, — 5 for TV = 
200, 500, 1000 each eigenvalue has been shifted by the empirical mean and scaled 
by iV 2 / 3 , for comparison a GOE Tracy- Widom distribution of zero mean and 
variance adjusted to match N = 500 data is also shown (data obtained from 
|18j). Similar agreement with Tracy- Widom and scaling in N 2 ^ 3 is obtained for 
any value of when conditioned on |,S| < 0.95. Note that for the parameters 
chosen here, the probability of l^l > 1 is still quite large (75.2%) at N = 1000. 
Even for such large values of N, the unconditional distribution of A max has a 
marked power-law tail of index \i (dotted line) and is very different from the 
asymptotic Tracy- Widom distribution (inset). 
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Poisson point process with Frechet intensity, as proven by Soshnikov in the case [i < 2 
|16j . His result therefore holds in the whole range fi < 4. Finally, the marginal case 
fj, = 4 is easy to understand from the above discussion. The number of entries exceeding 
one remains of order unity as N — > oo; the distribution of the largest entry S is Frechet 
with ^-independent parameters: 



4A A 

°n=4(\S\) = |^|5 ex P 



\S\" 



(3) 



The probability that \S\ exceeds 1 is tp = l — e~ A , in which case A max = |5| + 
otherwise, with probability 1 — <p, A max = 2. This characterizes entirely the asymptotic 
distribution of the largest eigenvalue in the marginal case [i = 4: it is a mixture 
of a 5-peak at 2 and a transformed Frechet distribution. Note that this asymptotic 
distribution is non-universal since it depends explicitly on the tail amplitude A. Again, 
all these results are convincingly borne out by numerical simulations, see [17] . The 
statistics of the second, third, etc. eigenvalues could be understood along the same 
lines. 

One can also consider the case of sample covariance matrices, important in many 
different contexts. The 'benchmark' spectrum of sample covariance matrix for iid Gaus- 
sian random variables is well known, and given by the Marcenko-Pastur distribution 
[j~9] . Here again, the spectrum has a well defined upper edge, and the distribution of 
the largest eigenvalue is Tracy- Widom (see e.g. |15j). What happens if the random 
variables have heavy tails? More precisely, we consider N times series of length T each, 
denoted x\, where i = 1,..,N and t = 1, T. The x\ have zero mean and unit variance, 
but may have power-law tails with exponent \x. For example, daily stock returns are 
believed to have heavy tails with an exponent /j, in the range 3 — 5 [2]. The empirical 
covariance matrix C is defined as: 

<^ = ^£44 ( 4 ) 
t 

When the time series are independent, and for T and ./V both diverging with a fixed 
ratio Q = T/N, the eigenvalues of C are distributed in the interval [(1 — Q^ 1 ^ 2 ) 2 , (1 + 
Q- 1 ' 2 ) 2 ]. When T — > oo at fixed N, all eigenvalues tend to unity, as they should 
since the empirical covariance matrix converges to its theoretical value, the identity 
matrix. When N and T are large but finite, the largest eigenvalue of C is, for Gaussian 
returns, a distance ~ N~ 2 ^ 3 away from the Marcenko-Pastur edge, with Tracy- Widom 
fluctuations. When returns are accidentally large, this may cause spurious apparent 
correlations and substantial overestimation of the largest eigenvalue of C. Let us be 
more specific and assume, as above, that one particular return, say x T a , is exceptionaly 
large, equal to S. A generalisation of the above self-consistent perturbation theory 
shows that whenever S < (iVT) 1 / 4 , the largest eigenvalue remains stuck at A max = 
(1 + Q -1 / 2 ) 2 , whereas when S > (NT) 1 ^, the largest eigenvalue becomes: 

A max = f A + 4- M 1 + 1^) ; (5) 



Q T I \ S 2 
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This result again enables us to understand the statistics of A max as a function of the 
tail exponent [i. For ./V times series of iid random variables, of length T each, the 
largest element is of order (NT) 1 ^. For /j, > 4, this is much smaller than (iVT) 1 / 4 
and, exactly as above, we expect the largest eigenvalue of C to be Tracy- Widom, 
with possibly large finite size corrections [20]. For /j, < 4, large 'spikes' in the time 
series dominate the top eigenvalues, which are of order A max ~ N i / fJj ~ 1 Q 2 / fl ~ 1 and 
distributed according to a Frechet distribution of index /i/2. In the marginal case 
H = 4, as above, A max has a finite probability to be equal to the Marcenko-Pastur value, 
and with the complementary probability it is distributed according to a transformed 
Frechet distribution of index 2, with a T and N independent scale. The structure of 
the corresponding eigenvectors can also be investigated and is again found to be partly 
localized when S > (iVT) 1 / 4 . Finally, we expect similar results to hold for the Random 
Singular Value problem studied in [21], where rectangular matrices corresponding to 
cross correlations between different sets of time series are considered. 



3 Directed Polymers, KPZ/KPP Equations and 
Pinned Manifolds 



Quite remarkably, the Tracy- Widom distribution for the largest eigenvalue of complex 
sample covariance matrices has deep links with the Directed Polymer (DP) problem 
in (1+1) dimension, defined as follows: consider a two dimensional square lattice, 
such that on each site one independently draws a random energy e(x, y) from a given 
distribution p(e). The zero-temperature directed polymer is the directed walk starting 
from (0, 0) and only allowed to move North-East, such that the sum of encountered 
energies is minimum. When e is an exponential variable, there is an exact mapping to 
the Tracy- Widom problem [13]. Thanks to this mapping, the DP in (1+1) dimension 
can be considered as a rare example of exactly soluble disordered system in finite 
dimensions, for which not only the scaling exponents but the full distribution of the 
ground state energy can be completely characterized in terms of the Tracy- Widom 
distribution. In particular, the scaling between the sample-to-sample fluctuations of 
the ground state energy AE and the length of the path L is AE ~ L 1 / 3 and the 
typical width of the optimal path is given by W ~ L 2 / 3 . These conjectured scalings, 
based on physical arguments, are therefore exact for a certain class of random energy 
distributions p(e). In the spirit of the above discussion, it is quite natural to wonder 
about the universality class of such results [22]. 

The question is all the more interesting that the DP problem maps onto a non-linear 
stochastic partial differential equation describing non-equilibrium surface growth, the 
so-called Kardar-Parisi-Zhang equation |23| : 




where h is the height of the interface, r the coordinates along the d-dimensional interface 
and rj a white noise term, mapping to the random energy e in the DP problem. (The 
(1+1) DP problem corresponds to d = 1). This equation can in turn be interpreted as 




dh(r, t) 
dt 




(6) 
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a Burgers equation on the quantity u = — V/i, which corresponds to the effective force 
acting on the end point of the directed polymer. But since the Burgers equation is a toy- 
model for turbulence, the question of the relevance of the distribution of the external 
forcing term V?y on the statistics of the velocity field is particularly interesting. KPZ- 
like equations may also describe very different physical situations, such as, for example, 
propagation of crack fronts in disordered materials [23]; the robustness of the results 
with respect to the nature of the randomness is therefore quite important. 

It is clear that it is the presence of a non-linear term in the KPZ/Burgers equation, 
responsible for the appearance of shocks in the velocity field, which makes the problem 
non trivial. For a linear KPZ equation A = 0, called the Edwards- Wilkinson equation 
in this context, it is easy to show that the long time statistics of h(f,t) is Gaussian 
provided 77 (f, t) has a finite second moment, again thanks to the Central Limit Theorem 
for sums. The interplay between non-linearity and fat tails does however lead to rather 
unexpected results, as suggested by a simple Flory argument in the case where p(e) 
decays, for large negative e, as p(e) ~ |e| _1_/i . The Flory argument compares the 
energy of the best 'bounty' site in a volume V = W d L to the elastic stretching energy 
the polymer has to pay to get there, of order W 2 /L. Using extreme value theory in 
the Frechet case, one gets E min ~ -V 1 ^, leading to W ~ LOHOA 2 /^) and AE ~ 

course, this reasonning is only valid if the extreme bounty 
site is worth the trip, i.e., if the distortion W is larger than in the absence of tails in 
the distribution of e. Calling Q the exponent relating W to L in the 'thin tail' case, 
one expects the results to be strongly affected by the power-law tail of p(e) as soon as 
[i is smaller than: 

^ <fJ,c = 2Q^T' (7) 

The exponent Qd is only known exactly in d = 1, with only numerical estimates available 
in d > 1 and still a very controversial situation concerning the value of the upper critical 
dimension d c above which Q takes the trivial random walk value £ = 1/2. In any case, 
for d = 1, (1 = 2/3, leading to fi c = 5. In other words, the Flory argument suggests 
that as soon as the fifth moment of the local energy distribution diverges, the Tracy- 
Widom scaling breaks down, contrarily to the naive expectation that the DP exponents 
are universal as long as the variance of the local disorder is finite. The value fj, c = 5 is 
also different from the critical value fj, c = 4 found for the statistics of the top eigenvalue 
of random matrices, showing that a general mapping between the two problems, if it 
exists, is more subtle. 

Summarising, the Flory argument suggests that in (1+1) dimensions, the energy 
fluctuations should scale as L 1 / 3 and by Tracy- Widom for fi > 5, and as L 3 /^" 1 ) for 
2 < n < 5 with a new type of limiting distribution (the case fi < 2 corresponds to a 
complete stretching of the polymer and was recently solved in [25J). We have conducted 
new numerical simulations of this problem which indeed confirm that for fi > 5, the 
ground state energy scales as L 1 / 3 with Tracy- Widom fluctuations, while for fi < 5 the 
above Flory prediction is very accurate. The distribution P of ground state energy 
can be well fitted by a geometric convolution of Frechet distributions, suggested by the 
Flory argument with a finite number of dominant sites: P = (1 — p)(F + pF*F +p 2 F-k 
F -k F + ...), different from the pure Frechet distributed reported above for the largest 
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eigenvalue for fi < 4. 

At this stage, a number of comments should be made. First, Eq. ([7]) shows that [i c 
diverges when d — > oo. This is perfectly in line with the Derrida-Spohn solution for the 
DP on a tree [26], which indeed breaks down completely as soon as p(e) decays slower 
than exponentially when e — ► oo. This, in turn, is related to the problem of fronts 
in the Kolmogorov-Petrovsky-Piscounov (KPP) equation when the initial condition 
decays too slowly into the unstable phase. Whereas for localised initial conditions, 
the front between the stable and unstable phase propagates at a well defined velocity 
(which determines the free-energy of the DP [26 , 27] ), the case of slowly decaying initial 
conditions has, to our knowledge, not been carefully investigated. The very notion 
of a propagating 'front' might disappear altogether, much like in models of epidemic 
propagation with infected individuals performing Levy flights, discussed in this context 
in [28]. 

Another intriguing property of Eq. (J7|) is that \i c diverges whenever Q = 1/2, 
independently of dimension. If a critical dimension exists such that the strong disorder 
fixed point has ^ = 1/2 for d > d c , then this fixed point should be unstable against 
power-law tailed disorder with arbitrarily high exponent \i. Since all moments of the 
disorder still exist in this case, it is difficult to see how perturbative methods can grasp 
such a strange behaviour. More generally, it is not obvious to see how perturbative 
renormalisation group methods for pinned systems (including the Functional RG) can 
deal with high moment anomalies which change the scaling exponents. This seems 
to us to be a very interesting technical challenge; its resolution might indirectly shed 
light on the still elusive nature of the strong disorder fixed point of the DP/KPZ 
problem in high dimensions [29] . A case where progress is possible is the problem 
of pinned manifold in the mean- field limit, which maps onto a deterministic Burgers 
equation for the effective force acting on the manifold [4]. Disorder is now entirely 
contained in the initial condition, which represents the (bare) microscopic pinning 
force. The statistics of the renormalized force, in particular the density and amplitude 
of the 'jumps' (Burgers shocks) responsible for the famous cusp in the renormalized 
correlation function predicted by the Functional RG, follows in this case the simple 
extreme value classification for independent random variables [U [30] . In particular, 
the case of a Gaussian pinning field is indeed in a different universality class than any 
power-law tailed disorder. Interestingly, the Functional RG has recently been casted 
in the form of a functional Burgers equation for the effective force in full generality 
|31j : this might provide a way to understand the importance of the statistics of the 
microscopic disorder in the general case as well. 

Finally, the presence of so-called 'temperature chaos' |32[ [33] might be quite sen- 
sitive to power-law tails in the microscopic disorder. Temperature chaos is associated 
with the fact that the free energy of the DP at non zero temperatures scales as L 1 / 3 , 
whereas both energy and entropy fluctuations are dominated by small scale fluctua- 
tions and therefore scale as L 1 / 2 3> L 1 / 3 . This implies that when temperature changes 
by a small amount ST, polymers of length L > L*, with 5TL* 1 / 2 = L* 1 / 3 must rear- 
range and find another equilibrium configuration. One finds L* ~ (5T) -1 / 6 , in good 
agreement with numerical work [33] and exact results on Migdal-Kadanoff lattices [34] . 
Interestingly, as long as \i > 2, entropy fluctuations should still scale as L 1 / 2 , whereas 
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free-energy scale as L 3// ( 2 ^ -1 ) when /x < 5. Hence, when [i < 7/2, small tempera- 
ture changes, or small disorder changes at zero temperature, are not strong enough 
perturbations to induce large scale rearrangements. 



4 Diffusion in a random potential 

On the failure of perturbative RG to grasp the potential relevance of "fat tails" , it is 
interesting to mention the case of Langevin diffusion in a random potential, i.e., the 
long-time behaviour of (x 2 (t)}, where x obeys: 

f = -VU(x)+fJ(x,t); (8) 

where r] is again a thermal noise and U(x) a random potential with short range cor- 
relations, over a length £. When U is Gaussian, one can show that diffusion is always 
normal, i.e. lim^ 00 (x 2 (t))/t = D > 0. Exact formulas for the value of D are available 
in 1 and 2 dimensions. Perhaps surprisingly, these formulas are exactly reproduced by 
a simple RG scheme, as independently proposed by Deem and Chandler [35], and Dean, 
Drummond and Horgan [36j. Physically, the time spent in a given region of space is 
t(x) ex expU(x)/T; because the potential has Gaussian tails the average of t(x) is fi- 
nite, and hence the diffusion normal, with D ~ £ 2 /( r )- But as soon as the disorder has 
tails decaying slower than exponential, the same argument leads to an infinite average 
trapping time and to subdiffusion. In the special case where p(U) ~ exp(— U/T g ), the 
model is similar to the trap model |3T|, I38j; one expects to find a critical temperature 
below which diffusion becomes anomalous, and (x 2 (t)) ~ with fj, < 1. This result was 
indeed recently confirmed exactly [39] ; however, the RG scheme which leads to such an 
accurate result for Gaussian potentials is totally blind to the tails of the disorder, and is 
unable to reproduce the above phase transition and subdiffusive behaviour. It would be 
very interesting to see how to adapt the RG scheme of [MIES] to subexponential tails; 
this might be an important technical breakthrough to address quantitatively the issue 
of activated dynamics in supercooled glasses below the Mode-Coupling temperature. 



5 Spin Glasses and non-standard RSB 

In this final section we address the emblematic spin-glass problem, in particular the 
mean-field Sherrington-Kirkpatrick (SK) model, from the point of view of extreme value 
statistics. The SK model is defined by the following mean-field Hamiltonian: 

W = --/=E J ^> *^ = ±1, (9) 

where Jjj are independent Gaussian random variables. It is now proven mathemati- 
cally that the full Replica Symmetry Broken solution invented by Parisi provides the 
exact solution fo the SK model and encodes in a rather magical way the complexity of 
the spin-glass phase [40J. Much insight into the meaning of Parisi's hierarchical con- 
struction is provided both by the cavity approach and by the Random Energy Model. 
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One understands that RSB is essentially a algebraic way to capture the Gumbel-Fisher- 
Tippett statistics of low lying energy states, which become relevant below the spin-glass 
transition [4|. The symptoms signalling that the replica symmetric (RS), one phase 
solution is unstable are well known: its entropy becomes negative below a certain tem- 
perature (and remains negative at zero temperature), and the spin-glass susceptibility, 
which measures the correlation of spin fluctuations, assumed to be negligible in the 
RS description, in fact diverges below the spin-glass transition temperature. One of 
the striking prediction of the RSB solution is the pseudo-gap in the distribution of 
local magnetic fields h, which vanishes linearly when h — ► 0: P(h) ~ Ah at T = 0, in 
contrast with the Gaussian distribution of h found in the RS phase. Interestingly, this 
pseudo-gap is intimately related to the marginal stability of the ground state configura- 
tion [41], and is the close analog of the Efros-Shklovskii gap in Coulomb glasses [42]. As 
a consequence of the vanishing of P(h) for small h's, the specific heat of the spin-glass 
grows as T 2 at small T, rather than the naively expected linear-in-T behaviour. 

How are these results affected by non Gaussian disorder? It is easy to be convinced, 
for example using the cavity method [43], that the SK results are universal provided 
the central limit theorem holds, i.e., the variance of the JijS is finite and correlations 
can be neglected. One knows that introducing strong correlations between the J^s, as 
is the case of the Random Orthogonal Model, may change the nature of the solution, 
for example from full RSB to one-step RSB [44] . When the J^s are iid variables with 
a power law tail \ Jij\~ 1 ~^ with fi < 2 such that the variance is infinite, interesting 
effects appear, related to the fact that some bonds become extremely strong compared 
to others, thereby decreasing the frustration in the system. For example, there is 
a 'trivial' spin glass phase, i.e. a phase where the Edwards-Anderson parameter is 
non zero and the RS solution is stable [45]. RS is broken below a second transition 
temperature Tat', however the precise nature of the RSB phase is still unknown. The 
puzzle is that one naively expects the distribution of low-energy states to be governed by 
Frechet statistics, since the energy is a sum of power-law distributed random variables. 
One knows from the study of the REM with power-law distributed energies that the 
solution in that case cannot be the standard Parisi replica symmetry breaking scheme 
[4J, which - as mentionned above - describes the Gumbel universality classo Things 
might however be more subtle: the energy of low lying states might be of the form 
Eo + e a , where Eq is indeed Frechet but common to all states, and a Gumbel residue e a , 
restoring the Parisi scheme. This should be associated with a distribution of overlaps 
q which does not extend down to q = 0. 

Even in the absence of a detailed solution below Tat, one can argue [45] that 
the distribution of local fields again develops a gap when 1 < fj, < 2, of the form 
P(h) ~ A^h^ 1 . Correspondingly, the specific heat now grows as T^ . The situation 
becomes quite interesting below \x = 1 since in this case replica symmetry appears to be 
restored at zero temperature, and the gap in P(h) disappears. The hierarchy between 
bonds is so strong for fi < 1 that only very weak bonds appear to be frustrated in that 
case, unable to generate a large number of different states. It would be very interesting 
to characterize in detail the solution of this 'Levy' SK model, and decide whether or 

2 The same remark applies to problems where the ground state energy is strictly bounded, 
such as the number partionning problem, falling into the Weibull universality class [46) . 
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not one needs to invent a non-standard RSB scheme for this problem. 

We again end this section by multifarious remarks. First, the Tracy- Widom problem 
of the largest eigenvalue of Random Matrices can be seen as the statistics of the ground 
state energy of the p = 2 spherical spin-glass. It is very natural to ask about the 
statistics of the ground state energy of the (hard-spin) SK model. Interestingly, this 
problem is still open. Numerically, it is known that the average ground state energy per 
spin converges towards the asymptotic, N = oo result predicted by the Parisi solution 
with _/V~ 2 / 3 corrections, as for the Tracy- Widom problem. Whether or not this is a 
coincidence is not understood; one should note that the sample-to-sample fluctuations 
of this ground state energy are not of order A r_2//3 (and not described by a Tracy- Widom 
distribution [47]) but of order with uj ~ 3/4 > 2/3. Again, there are no theoretical 
consensus on the value of u; [481 149 j; only qualitative arguments for uj = 3/4 exist. The 
generalisation of these arguments to Levy spin-glasses suggest uj = 1 — l//i 2 ; it would 
be interesting to have numerical data to test this prediction. Another natural extension 
of the Tracy- Widom problem within the context of spin-glasses is the statistics of the 
ground state energy of the spherical p-spin glass, which leads to a non-linear eigenvalue 
problem. In the p = 3 case, one should find the largest eigenvalue of: 



where Jijk are Gaussian random variables of variance 1/N 2 . It would be interesting to 
compute the scaling exponent describing the fluctuation of this new type of extreme 
value problem. Could this problem also be mapped to the directed polymer problem 
in higher dimension? 

Finally, we note that in finite dimensions, the role of the distribution of Jij on the 
universality class of the spin-glass transition was numerically investigated by Campbell 
et al. [50]; the consensus is however that (at least for fast-decaying) distribution, 
the critical exponents should be universal, with possibly large sub-leading corrections. 
However, the situation might change for power-law distributed couplings, as suggested 
by a Migdal-Kadanoff approach to the excitation energy exponent [48j . 




In summary, we reviewed several examples where the detailed shape of the distribution 
of randomness matters more than naively anticipated on the basis of the central limit 
theorem. The tail of the distribution is obviously important when one is concerned by 
extreme value problems, such as the statistics of the largest eigenvalue of heavy tailed 
random matrices, a problem we have discussed in detail. Another problem where 
the tails of the noise are crucial is the problem of barrier crossing and the Arrhenius 
law. This is not surprising: since barrier crossing is itself a rare event, its occurence 
may be much enhanced by the present of anomalous, non-Gaussian tails in the thermal 
noise. Note that the relevance of extreme value statistics to barrier height in disordered 
systems dates back to Rammal [51], see also [5^] . 




(10) 



jk=i 




6 Conclusion and open problems 
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More surprising, at least at first sight, is the importance of these tails for the statis- 
tics of fields obeying a non-linear differential equation, such as the Burgers, KPZ or 
KPP equations, either with a stochastic forcing or with a stochastic initial condition. 
This includes the example of the directed polymer in random environment or diffusion 
in a random potential; the scaling exponents of these problems is extremely sensitive 
to the tails of the disorder, an unusual feature from a field theoretical point of view. 
We have insisted on the technical challenges associated with this phenomenon: how 
should one generalize the (Functional) RG to account for non-Gaussian tails? Since 
the problem of pinned manifold can also be addressed using a replica field theory, one 
can similarly wonder if and how the Parisi replica symmetry breaking scheme has to 
be generalised in these cases. We have underlined several other open problems and 
conjectures, such as the general relation between top eigenvalues and directed poly- 
mers, the statistics of the ground state energy of the SK model, the nature of the low 
temperature phase of Levy spin-glasses, etc. The solution to these problems, beyond 
their mere technical interest, could shed some light on the subtleties and surprises of 
the physics of disordered systems. 

Acknowledgements: We thank G. Ben Arous, S. Boettcher, Z. Burda, D. Dean, A. 
Lefevre, S. Majumdar, O. Martin & M. Mezard for many useful discussions on these 
matters. 
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